Device with a front facing camera having discrete focus positions

ABSTRACT

A device with a front facing camera having two discrete focus positions is provided. The device comprises: a chassis comprising a front side; a display and a camera each at least partially located on the front side; the camera adjacent the display, the camera facing in a same direction as the display, the camera configured to: acquire video in a video mode; acquire an image in a camera mode; and, discretely step between a first and second focus position, the first position comprising a depth of field (“DOF”) at a hyperfocal distance and the second position comprising a DOF in a range of about 20 cm to about 1 meter; and, a processor configured to: when the camera is in the camera mode, automatically control the camera to the first position; and, when the camera is in the video mode, automatically control the camera to the second position.

FIELD

The specification relates generally to mobile devices with front facingcameras, and specifically to a device with a front facing camera havingtwo discrete focus positions.

BACKGROUND

Front facing cameras (FFC) in mobile handsets and/or mobile devices aregenerally fixed focus cameras which are not able to cover an entirerange of object distances. FFCs have often been used for video chatting;however they are increasingly being used for self-portraits and/orlandscapes as well. In these cases, fixed focus cameras are not able toachieve a good focus quality on both faces and objects at the same timedue to a limited DOF (Depth Of Field). Given the relatively tiny size ofFFC modules, a pixel size of image sensors of FFC tending towardsgetting smaller, hence larger apertures (and/or smaller F-numbers) arerequired for better low light performances. However, a small F-number onoptics makes DOF shorter. In other words, cameras with a small F-numbergenerally requires an auto-focus feature which, relative to a fixedfocus camera, increases cost, power consumption and process flowcomplexity at least due to auto-focus mechanisms and calibrations.

BRIEF DESCRIPTIONS OF THE DRAWINGS

For a better understanding of the various implementations describedherein and to show more clearly how they may be carried into effect,reference will now be made, by way of example only, to the accompanyingdrawings in which:

FIG. 1 depicts a device configured for changing communications of anaudio port between an applications processor and an audio processor,according to non-limiting implementations.

FIG. 2 depicts a schematic block diagram of the device of FIG. 1,according to non-limiting implementations.

FIG. 3 depicts a block diagram of a flowchart of a method for changingbetween focus positions in a front facing camera of the device of FIGS.1 and 2, according to non-limiting implementations.

FIG. 4 depicts the device of FIG. 2 with a user and feature in a fieldof view of the front facing camera, according to non-limitingimplementations.

FIG. 5 depicts a processor of the device of FIG. 2 changing a depth offield position of the front facing camera to between 20 cm and 1 meter,at least based on the camera device being in a video mode, according tonon-limiting implementations.

FIG. 6 depicts video acquired with a DOF between 20 cm and 1 meter in avideo mode, according to non-limiting implementations.

FIG. 7 depicts a processor of the device of FIG. 2 changing a depth offield position of the front facing camera to a hyperfocal distance, atleast based on the camera device being in a camera mode, according tonon-limiting implementations.

FIG. 8 depicts an image acquired with a DOF at a hyperfocal distance ina camera mode, according to non-limiting implementations.

FIG. 9 depicts selectable options for changing between focus positionsof the camera device, according to non-limiting implementations.

FIG. 10 depicts an image acquired with a DOF between 20 cm and 1 meterin a camera mode, according to non-limiting implementations.

DETAILED DESCRIPTION

In general, this disclosure is directed to a device, and in particular amobile device, which comprises a front facing camera (FFC) having twodiscrete focus positions: a first focus position at a hyperfocaldistance; and, a second focus position between about 20 cm and about 1meter, which can correspond to about an arm length of a user. The FFC iscontrolled to be in first focus position when the FFC is being used in acamera mode to acquire images, for example during acquisition ofself-portraits, also colloquially known as “selfies”. The FFC iscontrolled to be in second focus position when the FFC is being used ina video mode to acquire video, for example during video chatting. Eachof the focus positions are discrete positions in that the FFC does notoperate in an auto-focus mode, nor is the FFC enabled for auto-focus,nor is the FFC an auto-focus camera device. For example, as the focuspositions are discrete, the FFC can be configured to acquire imagesand/or video only at these two focus positions (though in someimplementations the FFC can include a third focus position, for examplebetween the first focus position and the second focus position, orshorter than the second focus position (e.g. in a macro mode)). Aprocessor of the device can control the FFC between positions based on amode of the FFC. Hence, when the camera device is in a camera mode, theprocessor automatically controls the camera device to the first focusposition so that images and/or selfies at a hyperfocal distance can beacquired; and, when the camera device is in a video mode, the processorautomatically controls the camera device to the second focus position sothat the FFC shows a user in focus, with a blurred background, forexample for video chatting.

In this specification, elements may be described as “configured to”perform one or more functions or “configured for” such functions. Ingeneral, an element that is configured to perform or configured forperforming a function is enabled to perform the function, or is suitablefor performing the function, or is adapted to perform the function, oris operable to perform the function, or is otherwise capable ofperforming the function.

It is understood that for the purpose of this specification, language of“at least one of X, Y, and Z” and “one or more of X, Y and Z” can beconstrued as X only, Y only, Z only, or any combination of two or moreitems X, Y, and Z (e.g., XYZ, XY, YZ, ZZ, and the like). Similar logiccan be applied for two or more items in any occurrence of “at least one. . . ” and “one or more . . . ” language.

An aspect of the specification provides a device comprising: a chassiscomprising a front side and a back side; a display device located on thefront side of the chassis; a camera device at least partially located onthe front side of the chassis adjacent the display device, the cameradevice facing in a same direction as the display device, the cameradevice configured to: acquire video in a video mode; acquire an image ina camera mode, the camera device being in one of the video mode or thecamera mode at any given time; and, discretely step between a firstfocus position and a second focus position, the first focus positioncomprising a depth of field (“DOF”) at a hyperfocal distance and thesecond focus position comprising a DOF in a range of about 20 cm toabout 1 meter; and, a processor configured to: when the camera device isin the camera mode, automatically control the camera device to the firstfocus position; and, when the camera device is in the video mode,automatically control the camera device to the second focus position.

The processor can be further configured to control the camera device tobe in one of the video mode or the camera mode based on a determineddistance between the device and a face in a field of view of the cameradevice. The device can further comprise a proximity detector configuredto determine a distance between the device and the face in a field ofview of the camera device.

Each of the first focus position and the second focus position can bediscrete focus positions of the camera device.

The camera device can be configured to step only between the first focusposition and the second focus position.

There can be no further focus positions of the camera device other thanthe first focus position and the second focus position.

The camera device can be configured to discretely step between the firstfocus position, the second focus position and a third focus position.

The video mode can correspond to a video chat mode and the camera modecan correspond to a selfie mode.

The device can further comprise an input device, the processor furtherconfigured to: control the camera device to the first focus position orthe second focus position based on input data received at the inputdevice.

Another aspect of the specification provides a method comprising: at adevice comprising: a chassis comprising a front side and a back side; adisplay device located on the front side of the chassis; a camera deviceat least partially located on the front side of the chassis adjacent thedisplay device, the camera device facing in a same direction as thedisplay device, the camera device configured to: acquire video in avideo mode; acquire an image in a camera mode, the camera device beingin one of the video mode or the camera mode at any given time; and,discretely step between a first focus position and a second focusposition, the first focus position comprising a depth of field (“DOF”)at a hyperfocal distance and the second focus position comprising a DOFin a range of about 20 cm to about 1 meter; and, a processor: when thecamera device is in the camera mode, automatically controlling, usingthe camera device, the camera device to the first focus position; and,when the camera device is in the video mode, automatically controlling,using the camera device, the camera device to the second focus position.

The method can further comprise controlling the camera device to be inone of the video mode or the camera mode based on a determined distancebetween the device and a face in a field of view of the camera device.The device can further comprise a proximity detector configured todetermine a distance between the device and the face in a field of viewof the camera device.

Each of the first focus position and the second focus position can bediscrete focus positions of the camera device.

The camera device can be configured to step only between the first focusposition and the second focus position.

There can be no further focus positions of the camera device other thanthe first focus position and the second focus position.

The camera device can be configured to discretely step between the firstfocus position, the second focus position and a third focus position.

The video mode can correspond to a video chat mode and the camera modecan correspond to a selfie mode.

The device can further comprise an input device, and the method canfurther comprise: controlling the camera device to the first focusposition or the second focus position based on input data received atthe input device.

Yet another aspect of the specification provides a computer-readablemedium storing a computer program, wherein execution of the computerprogram is for: at a device comprising: a chassis comprising a frontside and a back side; a display device located on the front side of thechassis; a camera device at least partially located on the front side ofthe chassis adjacent the display device, the camera device facing in asame direction as the display device the camera device configured to:acquire video in a video mode; acquire an image in a camera mode, thecamera device being in one of the video mode or the camera mode at anygiven time; and, discretely step between a first focus position and asecond focus position, the first focus position comprising a depth offield (“DOF”) at a hyperfocal distance and the second focus positioncomprising a DOF in a range of about 20 cm to about 1 meter; and, aprocessor: when the camera device is in the camera mode, automaticallycontrolling, using the camera device, the camera device to the firstfocus position; and, when the camera device is in the video mode,automatically controlling, using the camera device, the camera device tothe second focus position. The computer-readable medium can comprise anon-transitory computer-readable medium.

Attention is next directed to FIG. 1 and FIG. 2 which respectivelydepict a front perspective view and a schematic diagram of a mobileelectronic device 101 (referred to interchangeably hereafter as device101), according to non-limiting implementations. Device 101 comprises: achassis 109 comprising a front side and a back side (the front side isdepicted in FIG. 1); a display device 126 located on the front side ofchassis 109; a camera device 123 at least partially located on the frontside of chassis 109, adjacent display device 126, camera device 123facing in a same direction as display device 126, camera device 123configured to: acquire video in a video mode; acquire an image in acamera mode, camera device 123 being in one of the video mode or thecamera mode at any given time; and, discretely step between a firstfocus position and a second focus position, the first focus positioncomprising a depth of field (“DOF”) at a hyperfocal distance and thesecond focus position comprising a DOF in a range of about 20 cm toabout 1 meter; and, a processor 120 configured to: when camera device123 is in the camera mode, automatically control camera device 123 tothe first focus position; and, when camera device 123 is in the videomode, automatically control camera device 123 to the second focusposition. While only front side is depicted in FIG. 1, it is assumedthat a back side of chassis 109 is present, and can be configured forbeing held by human hand.

Device 101 can be any type of electronic device that can be used in aself-contained manner to acquire video and images using camera device123 and/or communicate with one or more communication networks. Device101 can include, but is not limited to, any suitable combination ofelectronic devices, communications devices, computing devices, personalcomputers, laptop computers, portable electronic devices, mobilecomputing devices, portable computing devices, tablet computing devices,laptop computing devices, desktop phones, telephones, PDAs (personaldigital assistants), cellphones, smartphones, e-readers,internet-enabled appliances, mobile camera devices and the like. Othersuitable devices are within the scope of present implementations. Forexample, device 101 need not comprise a mobile communication device, butrather can comprise a device with specialized functions, for example acamera device.

It should be emphasized that the shape and structure of device 101 inFIGS. 1 and 2 are purely examples, and contemplate a device that can beused for both wireless voice (e.g. telephony) and wireless datacommunications (e.g. email, web browsing, text, and the like). However,FIG. 1 contemplates a device that can be used for any suitablespecialized functions, including, but not limited, to one or more of,telephony, computing, camera, appliance, and/or entertainment relatedfunctions.

With reference to FIGS. 1 and 2, device 101 comprises at least one inputdevice 128 generally configured to receive input data, and can compriseany suitable combination of input devices, including but not limited toa keyboard, a keypad, a pointing device (as depicted in FIG. 1), amouse, a track wheel, a trackball, a touchpad, a touch screen (e.g.integrated with display device 126), and the like. Other suitable inputdevices are within the scope of present implementations.

Input from input device 128 is received at processor 120 (which can beimplemented as a plurality of processors, including but not limited toone or more central processors (“CPUs”)). Processor 120 can furthercomprise one or more hardware processors and/or digital signalprocessors (“DSP”). Processor 120 is configured to communicate with amemory 122 comprising a non-volatile storage unit (e.g. ErasableElectronic Programmable Read Only Memory (“EEPROM”), Flash Memory) and avolatile storage unit (e.g. random access memory (“RAM”)). Programminginstructions that implement the functional teachings of device 101 asdescribed herein are typically maintained, persistently, in memory 122and used by processor 120 which makes appropriate utilization ofvolatile storage during the execution of such programming instructions.Those skilled in the art will now recognize that memory 122 is anexample of computer readable media that can store programminginstructions executable on processor 120. Furthermore, memory 122 isalso an example of a memory unit and/or memory module.

Memory 122 further stores an application 146 that, when processed byprocessor 120, enables processor 120 to: when camera device 123 is inthe camera mode, automatically control camera device 123 to the firstfocus position; and, when camera device 123 is in the video mode,automatically control camera device 123 to the second focus position.

Furthermore, memory 122 storing application 146 is an example of acomputer program product, comprising a non-transitory computer usablemedium having a computer readable program code adapted to be executed toimplement a method, for example a method stored in application 146.

Camera device 123 comprises a front facing camera device, in that afront lens 201 and/or aperture of camera device 123 faces in a samedirection as display device 126 as depicted in both FIGS. 1 and 2.Indeed, in FIG. 1, while camera device 123 is only generally indicated,it is apparent that at least an external component and/or an apertureand/or lens 201 of camera device 123 is adjacent display device 126 andfacing forward, and/or is located on a front side of chassis 109 and/oris facing in a same direction as display device 126.

As depicted in FIG. 2, camera device 123 further comprises apparatus 203which can move discretely between a first focus position and a secondfocus position, with one of the focus positions depicted in solid linesin FIG. 2 and the other of the focus positions depicted in stippledlines in FIG. 2. Apparatus 203 can comprise one or more of an aperturedevice, a voice coil motor, and the like configured to control a DOF ofcamera device 123; specifically, when apparatus 203 is in a first focusposition, the DOF of camera device 123 comprises a hyperfocal distanceand in the second focus position, the DOF of camera device 123 is in arange of about 20 cm to about 1 meter. In particular non-limitingimplementations, a focal length of camera device 123 can be fixed, andthe DOF controlled by controlling an aperture device and the like.Furthermore, while FIG. 2 implies that the two focus positions arelocated linearly from one another, in other implementations, movementand/or stepping between the two positions can be rotational and/or inany other direction which results in the DOF being changed from betweena hyperfocal distance and in a range of about 20 cm to about 1 meter.

In particular, each of the first focus position and the second focusposition are discrete focus positions of camera device 123.Specifically, apparatus 203 steps between the two focus positionswithout stopping at positions in between. Hence, camera device 123 isnot an auto-focus camera with its attendant calibration issues, nor afixed focus camera with its attendant limited DOF range, but rather acamera device with discrete focus positions (i.e. there are no furtherfocus positions of the camera device other than the first focus positionand the second focus position).

In particular, the first focus position, with a hyperfocal distance DOF,can be used for self-portraits (i.e. selfies), while the second focusposition, with a DOF in a range of about 20 cm to about 1 meter, can beused for video chatting.

At the first focus position, a face of a user in the field of view ofcamera device 123 will be in focus, as well as features behind the user;hence, any images acquired at the first focus position will be suitablefor showing both a user and the background, which is generally a goal inselfies. In other words, the hyperfocal distance is a distance beyondwhich all objects can be brought into an “acceptable” focus. Inparticular, the hyperfocal distance can be the closest distance at whicha lens can be focused while keeping objects at infinity acceptablysharp; a lens is focused at this distance (e.g. lens 201), all objectsat distances from half of the hyperfocal distance out to infinity willbe acceptably sharp. Put another way, the hyperfocal distance is thedistance beyond which all objects are acceptably sharp, for a lensfocused at infinity. Hence, the hyperfocal distance at the first focusposition can comprise a DOF in which objects at infinity are generallyin focus (e.g. meet a threshold focus condition); for example, at thehyperfocal distance, the DOF of camera device 123 can be at infinityand/or set to a predetermined DOF in which objects located at infinityare sharp, which can be determined using thresholds. For example, thehyperfocal distance can be entirely dependent upon what level ofsharpness is considered to be “acceptable”. In some implementations,criterion for the desired acceptable sharpness can be specified througha circle of confusion (CoC) diameter limit defined as a largestacceptable spot size diameter that an infinitesimal point is allowed tospread out to on the imaging medium (film, digital sensor, etc.).

At the second focus position, a face of a user in the field of view ofcamera device 123 will be in focus, but features behind the user willnot be in focus; hence, any video acquired at the second focus positionwill be suitable for showing a user, but the background will not be infocus, which is generally a goal in video chatting. As it is assumedthat a user will be holding device 101 away from his/her face using hisarm, the DOF of the second focus position is selected to be within anarm length, i.e. between about 20 cm and about 1 meter. In the lower endof the selected range, it is assumed that users will bend their armswhen looking into camera device 123.

Put another way, the video mode of camera device 123 can correspond to avideo chat mode and the camera mode of camera device 123 can correspondto a selfie mode.

Indeed, in some implementations, camera device 123 is configured to steponly between the first focus position and the second focus position,without stopping at positions in-between. Indeed, in theseimplementations, camera device 123 cannot stop at positions between thefirst focus position and the second focus position as the first focusposition and the second focus position are discrete positions and notcontinuous positions, as would be used in an auto-focus camera device.

In other words, apparatus 203 of camera device 123 is configured to stepto predetermined discrete physical positions (corresponding to the twofocus positions) without stopping in between. Hence, camera device 123is configured to acquire images and/or video using two sets of discreteoptical conditions: a first set of optical conditions defined by thefirst focus position and a second set of optical conditions defined bythe second focus position. Indeed, while configuring and/ormanufacturing camera device 123 in such a manner is more expensive thanmanufacturing a fixed focus camera device, it is less expensive thanmanufacturing an auto-focus camera device.

However, in yet further implementations, camera device 123 can beconfigured to discretely step between the first focus position, thesecond focus position and a third focus position, for example betweenthe first focus position and the second focus position (e.g. between 1meter and the hyperfocal distance), less than the second focus position(i.e. having a DOF of less than about 20 cm). Hence, in theseimplementations, camera device 123 can acquire images and/or video atthree discrete DOFs.

Furthermore, camera device 123 is configured to: acquire video in avideo mode; and acquire an image in a camera mode, camera device 123being in one of the video mode or the camera mode at any given time.While video can be acquired in the camera mode, such video is not storedbut is rendered at display device 126 in near real-time to assist a userwith positioning their face in a frame in order to acquire (i.e. store)an image in memory 122. For example, while not depicted, camera device123 generally comprises a sensor, including but not limited to CCD(charge-coupled device), which can acquire (i.e. store in memory 122)one image at a time in a camera mode (though the sensor in the cameramode can also acquire images in bursts), or a video stream in a videomode.

In general, camera device 123 operates either in the camera mode or inthe video mode, for example under control of processor 120 and/or wheninput data is received at input device 128 to control a mode of cameradevice 123. For example, while not depicted, processor 120 can controldisplay device 126 to render selectable options (e.g. in a graphic userinterface (GUI), a pull-down menu), for selecting whether to use cameradevice 123 in a camera mode or a video mode; in other words, a user canselect whether to use camera device 123 in camera mode or a video modeby selecting a corresponding selectable option from the GUI.

Alternatively, and as depicted, device 101 can comprise a proximitydetector 205 configured to determine a distance between device 101 and aface in a field of view of camera device 123. Proximity detector 205 caninclude, but is not limited to, a time-of-flight detector. In theseimplementations, processor 120 can process images and/or video acquiredusing camera device 123, determine whether the images and/or videoincludes a face (e.g. using a face detection algorithm which can beincluded in application 146) and, when the images and/or video includesa face, processor 120 can query proximity detector 205 to determine adistance of an object to device 101, which is assumed to be the face.

When the distance from the proximity detector 205 meets given respectivethreshold conditions, which can be stored at memory 122, for example inapplication 146, processor 120 can control camera device 123 to be in acamera mode or a video mode. For example, when the distance of thedetected object to device 101 is less than about 20 cm, processor 120can control camera device 123 to be in a video mode; and when thedistance of the detected object to device 101 is greater than about 20cm, processor 120 can control camera device 123 to be in a camera mode.However, other threshold conditions are within the scope of presentimplementations. Regardless, camera device 123 is changed accordingly toa corresponding DOF mode depending on which given respective thresholdcondition is met.

Hence, a focus position of camera device can be controlled by processor120 based on a number of factors though, generally, processor 120automatically controls the camera device to the first focus positionwhen camera device 123 is in the camera mode; and, automatically controlthe camera device to the second focus position when camera device 123 isin the video mode.

Processor 120 can be further configured to communicate with display 126,which comprises any suitable one of, or combination of, flat paneldisplays (e.g. LCD (liquid crystal display), plasma displays, OLED(organic light emitting diode) displays, capacitive or resistivetouchscreens, CRTs (cathode ray tubes) and the like).

As depicted, device 101 further comprises an optional speaker 132 and anoptional microphone 134. Speaker 132 comprises any suitable speaker forconverting audio data to sound to provide one or more of audible alerts,audible communications from remote communication devices, and the like.Microphone 134 comprises any suitable microphone for receiving sound andconverting to audio data. Speaker 132 and microphone 134 can be used incombination to implement telephone functions at device 101.

In some implementations, input device 128 and display 126 are externalto device 101, with processor 120 in communication with each of inputdevice 128 and display 126 via a suitable connection and/or link.

As depicted, processor 120 also connects to optional communicationinterface 124 (interchangeably referred to as interface 124), which canbe implemented as one or more radios and/or connectors and/or networkadaptors, configured to wirelessly communicate with one or morecommunication networks (not depicted). It will be appreciated thatinterface 124 is configured to correspond with network architecture thatis used to implement one or more communication links to the one or morecommunication networks, including but not limited to any suitablecombination of USB (universal serial bus) cables, serial cables,wireless links, cell-phone links, cellular network links (including butnot limited to 2G, 2.5G, 3G, 4G+ such as UMTS (Universal MobileTelecommunications System), GSM (Global System for MobileCommunications), CDMA (Code division multiple access), FDD (frequencydivision duplexing), LTE (Long Term Evolution), TDD (time divisionduplexing), TDD-LTE (TDD-Long Term Evolution), TD-SCDMA (Time DivisionSynchronous Code Division Multiple Access) and the like, wireless data,Bluetooth links, NFC (near field communication) links, WLAN (wirelesslocal area network) links, WiFi links, WiMax links, packet based links;the Internet, analog networks, the PSTN (public switched telephonenetwork), access points, and the like, and/or a combination.

While not depicted, device 101 further comprises a power supply,including, but not limited to, a battery, a power pack and the like,and/or a connection to a mains power supply and/or a power adaptor (e.g.an AC-to-DC (alternating current to direct current) adaptor). In generalthe power supply powers components of device 101.

Further, it should be understood that in general a wide variety ofconfigurations for device 101 are contemplated. For example, while notdepicted, device 101 can further comprise a back facing camera at leastpartially located on a back side of chassis 109, and configured foracquiring images and/or video in a direction opposite camera device 123.

Attention is now directed to FIG. 3 which depicts a block diagram of aflowchart of a method 300 of controlling a camera device betweendiscrete focus positions, according to non-limiting implementations. Inorder to assist in the explanation of method 300, it will be assumedthat method 300 is performed using device 101, and specifically byprocessor 120, for example when processor 120 processes application 146.Indeed, method 300 is one way in which device 101 can be configured.Furthermore, the following discussion of method 300 will lead to afurther understanding of device 101, and its various components.However, it is to be understood that device 101 and/or method 300 can bevaried, and need not work exactly as discussed herein in conjunctionwith each other, and that such variations are within the scope ofpresent implementations.

Regardless, it is to be emphasized, that method 300 need not beperformed in the exact sequence as shown, unless otherwise indicated;and likewise various blocks may be performed in parallel rather than insequence; hence the elements of method 300 are referred to herein as“blocks” rather than “steps”. It is also to be understood, however, thatmethod 300 can be implemented on variations of device 101 as well.

It is further appreciated that blocks 301 to 307 are optional.

At optional block 301, processor 120 can determine whether a face isdetected in images and/or video acquired by camera device 123. Block 301can repeat when no face is detected (i.e. a “No” decision at block 301);in other words, block 301 can repeat until a face is detected. Faces canbe detected by processor 120 processing images and/or video, acquired bycamera device 123, in conjunction with a face detection algorithm.

At optional block 303, which is implemented when a face is detected(i.e. a “Yes” decision at block 301), processor 120 can determine adistance from device 101 to the detected face, for example usingproximity detector 205.

At optional block 305, processor 120 can control camera device 123 to bein one of the video mode or the camera mode based on the determineddistance between the device and the face, which is appreciated to belocated in the field of view of camera device 123, for example based onrespective threshold distances as described above.

At optional block 307, processor 120 can determine whether camera device123 is in the camera mode or the video mode, for example when processor120 has not already determined such.

At block 309, when camera device 123 is in the camera mode (e.g. atblock 307, processor 120 determines that camera device 123 is in thecamera mode and/or processor 120 has previously controlled camera device123 to the camera mode), processor 120 automatically controls cameradevice 123 to the first focus position.

Alternatively, at block 311, when camera device 123 is in the video mode(e.g. at block 307, processor 120 determines that camera device 123 isin the video mode and/or processor 120 has previously controlled cameradevice 123 to the video mode), processor 120 automatically controlscamera device 123 to the second focus position.

Method 300 is now described with reference to FIGS. 4 to 10, with FIGS.4, 5 and 7 being substantially similar to FIG. 2 with like elementshaving like numbers, unless otherwise noted, and FIGS. 6, 8, 9 and 10being substantially similar to FIG. 2 with like elements having likenumbers.

Attention is next directed to FIG. 4, which schematically depicts a user401 and a feature 403 (e.g. a tree) in a field of view of camera device123. Apparatus 203 can be in an arbitrary one of the first focusposition and the second focus position, for example a last focusposition and/or a rest focus position and/or a default focus position(which can be either of the first focus position and the second focusposition). It is further assumed in FIG. 4 that processor 120 isprocessing application 146, which can include a general cameraapplication, in addition to the functionality described above.

In any event, a face of user 401 is appreciated to be in a field of viewof camera device 123, while feature 403 is appreciated to be locatedbehind user 401, and also visible in the field of view of camera device123, for example over a shoulder of user 401.

In FIG. 4, processor 120 can acquire an image 405 (and/or video) of user401 and feature 403 using current settings of camera device 123 and/ordefault settings of camera device 123.

As also depicted in FIG. 4, processor 120 processes image 405 todetermine whether a face is present in image 405 (e.g. block 301 ofmethod 300), for example using a face detection algorithm, which can bepart of application 146.

When image 405 includes a face (assumed in FIG. 4), processor 120 canquery proximity detector 205 to return a distance 407 between device 101and user 401 (e.g. block 303 of method 300). Processor 120 can processdistance 407 to determine whether distance 407 meets given thresholdconditions stored in memory 122, for example in application 146, thegiven respective threshold conditions associated with controlling cameradevice 123 to one of camera mode or video mode, as described above.

Assuming that a respective threshold condition is met, processor 120controls camera device 123 to control camera device 123 to be in one ofthe video mode or the camera mode based on determined distance 407between device 101 and the face in the field of view of camera device123 (e.g. block 305 of method 300), as described hereafter.

Attention is next directed to FIG. 5, where it is assumed that at block307, processor 120 has determined that camera device 123 is in videomode, and hence processor 120 automatically controls camera device 123to the second focus position. For example, assuming that a focusposition of camera device 123 in FIG. 4 is the first focus position, andassuming that processor 120 determines at block 307 that camera device123 is in video mode, in FIG. 5 processor 120 controls camera device 123(for example by transmitting a command 501 thereto) which causesapparatus 203 to move to the position corresponding to the second focusposition (e.g. block 311 of method 300), where the DOF of camera device123 is in a range of about 20 cm to about 1 meter. In other words, invideo mode, the DOF of camera device 123 is automatically controlled tovalues which are associated with video chatting, for example in a rangeof about 20 cm to about 1 meter.

The resulting images and/or video are depicted in FIG. 6, which depictsvideo rendered at display device 126, where a face of user 401 is infocus and feature 403 is out of focus (as indicated by feature 403 beingdrawn in stippled lines). As depicted, the video rendered at displaydevice 126 includes an optional indicator 601 indicating that cameradevice 123 is in a video mode, for example for video chatting.

Attention is next directed to FIG. 7, where it is assumed that at block307, processor 120 has determined that camera device 123 is in cameramode, and hence processor 120 automatically controls camera device 123to the first focus position. For example, assuming that a focus positionof camera device 123 in FIG. 4 is the first focus position, and assumingthat processor 120 determines at block 307 that camera device 123 is invideo mode, in FIG. 5 processor 120 controls camera device 123 (forexample by transmitting a command 701 thereto) which causes apparatus203 to move to the position corresponding to the second focus position(e.g. block 311 of method 300), where the DOF of camera device 123 is atthe hyperfocal distance. In implementations where camera device 123 isalready in the first focus position, command 701 is optional. In otherwords, in camera mode, the DOF of camera device 123 is automaticallycontrolled to values which are associated with acquiring self-portraitsand/or selfies, for the hyperfocal distance.

A resulting image is depicted in FIG. 8, which depicts an image renderedat display device 126, where a face of user 401 is in focus and feature403 is also in focus (as indicated by feature 403 being drawn in solidlines). As depicted, the image rendered at display device 126 includesan optional indicator 801 indicating that camera device 123 is in acamera mode and/or selfie mode, for example for acquiring self-portraitsthat include features behind user 401.

As described above, camera device 123 comprises two discrete focuspositions, a first focus position where the DOF is at the hyperfocaldistance, and a second focus position where the DOF is in a range ofabout 20 cm to about 1 meter. When camera device 123 is in camera mode,processor 120 controls camera device 123 to the first focus position, sothat selfies can be taken, and when camera device 123 is in video mode,processor 120 controls camera device 123 to the second focus positionfor video chatting. However, in some implementations, input device 128can be used to change between focus positions regardless of a mode ofcamera device 123. In such implementations, processor 120 is furtherconfigured to: control camera device 123 to the first focus position orthe second focus position based on input data received at input device128.

For example, attention is next directed to FIG. 9 which is similar toFIG. 8, with like elements having like numbers. Hence, in FIG. 9, cameradevice 123 has been controlled to a camera mode, and to the first focusposition so that the DOF is at the hyperfocal distance. However, FIG. 9further depicts a pull-down menu 901 comprising selectable options“Selfie” and “Video Chat” corresponding, respectively, to the firstfocus position and the second focus position. FIG. 9 also depicts a hand903 of user 401 selecting option “Video Chat” in order to change a focusposition of camera device 123 from the first position to the secondposition, assuming that input device 128 includes a touchscreen ofdisplay device 126. However, other formats for presenting and/orselecting selectable options for changing focus positions, other thanpull-down menus, are within the scope of present implementations.

FIG. 10 depicts device 101 after selectable option “Video Chat” has beenselected while camera device 123 is in camera mode. Specifically, cameradevice 123 changes to second focus position so that the DOF is in arange of 20 cm to 1 meter, while camera device 123 remains in cameramode, such that a face of user 401 is in focus but feature 403 is out offocus, as in FIG. 6 (where camera device 123 is in video mode). Optionalindicator 801 changes to optional indicator 1001 which indicates thatcamera device 123 is in camera mode but with a “Short” DOF;alternatively, a numerical value of the DOF could be provided and/oranother subjective indicator which indicates that camera device 123 isin the second focus position. While not depicted, when camera device 123is in video mode, menu 901 can be used to change camera device 123 fromthe second focus position to the first focus position, so that video canbe acquired by camera device 123 with a DOF at the hyperfocal distance.

In any event, provided herein is a device that includes a front facingcamera device that can be changed between two discrete focus positions,which are optimized for use with a video mode and a camera mode, andspecifically optimized for video chatting and selfie acquisitions. Thedevice can automatically adjust the front facing camera device betweenthe two discrete focus positions based on whether the front facingcamera device is in a video mode or a camera mode, using an underlyingassumption that in video mode, the front facing camera device is to beused for video chatting, and in camera mode the front facing cameradevice is to be used for acquiring selfies. In general, the DOF for thediscrete focus position for selfies is a hyperfocal distance, and theDOF for the discrete focus position for selfies is in a range of about20 cm to about 1 meter. While in some implementations, there are onlytwo discrete focus positions, in other implementations there can bethree discrete focus positions, though the DOF for the discrete focusposition for selfies is a hyperfocal distance is neither an auto-focuscamera device nor a fixed focus camera device.

Those skilled in the art will appreciate that in some implementations,the functionality of device 101 can be implemented using pre-programmedhardware or firmware elements (e.g., application specific integratedcircuits (ASICs), electrically erasable programmable read-only memories(EEPROMs), etc.), or other related components. In other implementations,the functionality of device 101 can be achieved using a computingapparatus that has access to a code memory (not depicted) which storescomputer-readable program code for operation of the computing apparatus.The computer-readable program code could be stored on a computerreadable storage medium which is fixed, tangible and readable directlyby these components, (e.g., removable diskette, CD-ROM, ROM, fixed disk,USB drive). Furthermore, the computer-readable program can be stored asa computer program product comprising a computer usable medium. Further,a persistent storage device can comprise the computer readable programcode. The computer-readable program code and/or computer usable mediumcan comprise a non-transitory computer-readable program code and/ornon-transitory computer usable medium. Alternatively, thecomputer-readable program code could be stored remotely buttransmittable to these components via a modem or other interface deviceconnected to a network (including, without limitation, the Internet)over a transmission medium. The transmission medium can be either anon-mobile medium (e.g., optical and/or digital and/or analogcommunications lines) or a mobile medium (e.g., microwave, infrared,free-space optical or other transmission schemes) or a combinationthereof.

A portion of the disclosure of this patent document contains materialwhich is subject to copyright protection. The copyright owner has noobjection to the facsimile reproduction by any one of the patentdocument or patent disclosure, as it appears in the Patent and TrademarkOffice patent file or records, but otherwise reserves all copyrightswhatsoever

Persons skilled in the art will appreciate that there are yet morealternative implementations and modifications possible, and that theabove examples are only illustrations of one or more implementations.The scope, therefore, is only to be limited by the claims appendedhereto.

What is claimed is:
 1. A device comprising: a chassis comprising a frontside and a back side; a display device located on the front side of thechassis; a camera device at least partially located on the front side ofthe chassis adjacent the display device, the camera device facing in asame direction as the display device, the camera device configured to:acquire video in a video mode; acquire an image in a camera mode, thecamera device being in one of the video mode or the camera mode at anygiven time; and, discretely step between a first focus position and asecond focus position, the first focus position comprising a depth offield (“DOF”) at a hyperfocal distance and the second focus positioncomprising a DOF in a range of about 20 cm to about 1 meter; a proximitydetector configured to determine a distance between the device and aface in a field of view of the camera device; and, a processorconfigured to: determine, using the proximity detector, the distancebetween the device and the face; when the distance is greater than about20 cm, automatically control the camera device to the camera mode, andwhen the camera device is in the camera mode, automatically control thecamera device to the first focus position; and, when the distance isless than about 20 cm, automatically control the camera device to thevideo mode, and when the camera device is in the video mode,automatically control the camera device to the second focus position. 2.The device of claim 1, wherein each of the first focus position and thesecond focus position are discrete focus positions of the camera device.3. The device of claim 1, wherein the camera device is configured tostep only between the first focus position and the second focusposition.
 4. The device of claim 1, wherein there are no further focuspositions of the camera device other than the first focus position andthe second focus position.
 5. The device of claim 1, wherein the cameradevice is configured to discretely step between the first focusposition, the second focus position and a third focus position.
 6. Thedevice of claim 1, wherein the video mode corresponds to a video chatmode and the camera mode corresponds to a selfie mode.
 7. The device ofclaim 1, further comprising an input device, the processor furtherconfigured to: control the camera device to the first focus position orthe second focus position based on input data received at the inputdevice.
 8. A method comprising: at a device comprising: a chassiscomprising a front side and a back side; a display device located on thefront side of the chassis; a camera device at least partially located onthe front side of the chassis adjacent the display device, the cameradevice facing in a same direction as the display device, the cameradevice configured to: acquire video in a video mode; acquire an image ina camera mode, the camera device being in one of the video mode or thecamera mode at any given time; and, discretely step between a firstfocus position and a second focus position, the first focus positioncomprising a depth of field (“DOF”) at a hyperfocal distance and thesecond focus position comprising a DOF in a range of about 20 cm toabout 1 meter; a proximity detector configured to determine a distancebetween the device and a face in a field of view of the camera device;and, a processor: determining, using the proximity detector, thedistance between the device and the face; when the distance is greaterthan about 20 cm, automatically controlling the camera device to thecamera mode, and when the camera device is in the camera mode,automatically controlling, using the camera device, the camera device tothe first focus position; and, when the distance is less than about 20cm, automatically controlling the camera device to the video mode, andwhen the camera device is in the video mode, automatically controlling,using the camera device, the camera device to the second focus position.9. The method of claim 8, wherein each of the first focus position andthe second focus position are discrete focus positions of the cameradevice.
 10. The method of claim 8, wherein the camera device isconfigured to step only between the first focus position and the secondfocus position.
 11. The method of claim 8, wherein there are no furtherfocus positions of the camera device other than the first focus positionand the second focus position.
 12. The method of claim 8, wherein thecamera device is configured to discretely step between the first focusposition, the second focus position and a third focus position.
 13. Themethod of claim 8, wherein the video mode corresponds to a video chatmode and the camera mode corresponds to a selfie mode.
 14. The method ofclaim 8, wherein the device further comprises an input device, and themethod further comprises: controlling the camera device to the firstfocus position or the second focus position based on input data receivedat the input device.
 15. A non-transitory computer-readable mediumstoring a computer program, wherein execution of the computer program isfor: at a device comprising: a chassis comprising a front side and aback side; a display device located on the front side of the chassis; acamera device at least partially located on the front side of thechassis adjacent the display device, the camera device facing in a samedirection as the display device, the camera device configured to:acquire video in a video mode; acquire an image in a camera mode, thecamera device being in one of the video mode or the camera mode at anygiven time; and, discretely step between a first focus position and asecond focus position, the first focus position comprising a depth offield (“DOF”) at a hyperfocal distance and the second focus positioncomprising a DOF in a range of about 20 cm to about 1 meter; a proximitydetector configured to determine a distance between the device and aface in a field of view of the camera device; and, a processor:determining, using the proximity detector, the distance between thedevice and the face; when the distance is greater than about 20 cm,automatically controlling the camera device to the camera mode, and whenthe camera device is in the camera mode, automatically controlling,using the camera device, the camera device to the first focus position;and, when the distance is less than about 20 cm, automaticallycontrolling the camera device to the video mode, and when the cameradevice is in the video mode, automatically controlling, using the cameradevice, the camera device to the second focus position.